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[57] ABSTRACT 

Apparatus and methods are disclosed which are most 
advantageously used in conjunction with t digital com- 
puter to provide improved graphics capability. These 
techniques permit the representation and manipulation 
of any arbitrarily shaped image in terms of •'inversion 
points". Inversion points defining a region are sorted 
and stored such that the region shape may be regener- 
ated at a later time from the inversion points. Means are 
provided to compare existing regions and new regions 
to be displayed, and region operators are provided to 
specify a precedence between the existing and new 
regions. Thus, new regions are appropriately "clipped" 
such that only portions of a new region may actually be 
displayed to achieve the desired graphic representation. 

35 Chums, 20 Drawing Figures 
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The Smalltalk Environment", BYTE, August 1981, 

METHOD AND APPARATUS FOR IMAGE page 90, Vol. 6, No. 8. 

COMPRESSION AND MANIPULATION Although a variety of graphic representation* ire 

desired in Smalltalk or other systems, traditionally large 
BACKGROUND OF THE INVENTION 5 amounts of memory have been required in order gener- 
. p. ,j ate, store and manipulate graphics characters. In its 
The present invention relates tc apparatus and mtth- ^plest «°nn, * block of memory may be allocated in t 
ods for displaying graphic information. More particu- data processing storage system with each memory bit (a 
larly, the present invention relates to data processing 1 or 0) mapped onto a corresponding picture element 
apparatus and methods for generating and manipulating ,0 (pixel) on the display system. Thus, an entire CRT 
images and data on a display system. screen full of data, in the form of images and/or text, » 
2. Prior Art represented as either a 1 (black dot) or a (white dot) in 
In the computing industry, it is quite common to a block of memory known as a "bitmap". However, the 
represent and convey information to a use: through use of a one-to-one correspondance between the bitmap 
graphic representations. These representations may ,5 and the CRT display requires a significant amount of 
take a variety of forms, such as for example alphanu- storage space within the computer's core memory. In 
meric characters, cartesian or other coordinante graphs, addition, the generation and manipulation of an image 
as well as shapes of well known physical objects, etc. or character requires that virtually all bits in the bitmap 
Historically, humans have interfaced with computers be updated after any modification to an image or the 
through a system of discrete commands which typically 20 ifo, Thi s procedure is both repetitive and time consum- 
comprise a combination of both text and mathematical jj,g, and significantly hampers the practical use of inter- 
symbolic characters. Examples of such systems are active graphics display operating systems, 
numerous and include the programming languages of One method of providing the necessary graphic capa- 
Fortran, Algol, PL/1, Basic, and Cobol, which trans- bilities, for systems such as Smalltalk, is "BitBlt" (Bit 
form a given set of user commands into machine execut- 25 Boundry Block Transfer) as developed by the Xerox 
able "object" code. Learning Research Group, Palo Alto Research Center, 
However, the ease with which a user becomes profi- Palo A]t0) q^ ^ D . i nga u Si "The Smalltalk Graph- 
cient in programming or interacting with a computer jcs Kerna ]» BY TE, page 168, August 1981, Vol. 6 No. 
based system is generally a function of how close the g BjtBU utUizes fegions whkh m fog^ves ^^ 
system models the logical thought of the user himself. If 30 bj ^ defme . fe {Qim ^ Such w for ^ m 
the user is able to enter commands in the order ui which gmw hwd sha ^ form t0 ^ u^ „ a cmoTf a pa,, 
he would find most logically appropriate, rather than ^ mm as will be discussed more fully below, 
having to transpose his desired command into the code ^^ characters from , sourC€ bit 5uch ^ for 
of a programming language, greater user ef feciency m ^ § ^ ^ rf c WtcrS) t0 , dcstma tion bitmap 
using the system is achieved. 35 * on 

One system which has been developed to minimize yr u,uv -* " ? ,/,;. 11M> nt . „/■• 

. " * , . . , T. , . given coordinates. By incorporating the use 01 a chp- 

the earning and acclamation period which a user must *r c " "~ iv " , , , > .. «~ * , . . ,; 

go through in order to become proficient in the fatten* P^vf * I f ' ^Xt/?Xtl of S« 
tion with a computer system ,s frequently referred to as <™ b'tmapwhich can be effected a port,™ of a Urger 
an "object-oriented" cr "Smalltalk 1 ' system. The Small- 40 «ne can be mapped into a window such hatonly that 
talk approach is to replace many common coded pro- P«*» of the transferred scene which falls withm the 
gramming commands with two-dimensional graphics window will be transferred. In jdd.don a vanrty of 
and animation on a computer display. Quantitatively, it transfer operations are provided winch control the 
has been found that since people readily think in terms combination of a transferred scene or character with an 
of images, a person can absorb and manipulate informa- 45 existing scene previously stored at the destination bil- 
lion presented in a visual context much faster than if ™P- However, the BitBlt system is limited in terms of 
represented by text. The particular type of graphic the types of images which can be transferred and manip- 
interface by which the user interacts with the machine ulated. Specifically, BitBlt is constrained to transfers of 
may vary for any given application. rectangular areas. This limitation significantly restrict* 
One common Smalltalk interface approach utilizes 50 its use as a graphics tool since BitBlt is thereby unable to 
multiple "windows" displayed on a cathode ray tube transfer data to overlapping windows or the like. In 
(CRT) in which combinations of text and graphics are addition, large amounts of memory are required for the 
used to convey information. For example, e-ch window BitBlt system. Other limitations in prior art systems, 
may take the form of a file folder, of the type used in a such as BitBlt, are described m this Patent in order to 
standard filing cabinet, overlapping other folders, with 55 more fully identify the nature of the present invention, 
the "top" fully visible folder constituting the current As will be disclosed below, the present invention 
workfile. A user may add or delete information from a provides a means whereby any arbitrarily shaped region 
file, refile the file folder in another location, and gener- may be defined and stored using significantly less mem- 
ally operate on the file just as if an actual file in an office ory than was previously possible in the prior art Addi- 
was being used. Thus, by graphically presenting an 60 tionally, the present invention provides a means 
image which represents the object of the user's com- whereby operations may be performed on regions effi- 
mand, and allowing the user to operate on and manipu- ciently and quickly by a digital computer, 
late the image in substantially the same way he would as SUMMARY OF THE INVENTION 
if the image constituted the actual object, the machine 

becomes easier to operate to the user and a stronger 65 The present invention provides methods and appara- 

man-machine interface is achieved. See, for example, D. tus which are most advantageously used in conjunction 

Robson, "Object-Oriented Software Systems", BYTE, with a digital computer to provide improved graphics 

August 1981, Page 74, Vol. 6, No. 8; and L. Tesler, capability. These techniques permit the representation 
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and manipulation of any arbitrarily defined rf gion in FIGS. 4(aH') illustrate operations on regions using 

terms of "Inversion Points". An inversion poult is by inversion points which may be accomplished using the 

definition 3 point at which the state of all points having present invention. • ■„ 

coordinates to the right and below the subject point .re FIG. 5 illustrates the process of converting a region 

inverted (e.g. binary zeros are converted to binary ones 5 defined by mversion points into a one scan hue buffer 

and visa versa). A "Region" is defined as any arbitrary sca^g vertically down *J*0™; 

areawhichrnayinclude.numberofgroupsofdisjoint FIG. 6 symbolically illustrates the AND opera**. 

areas. Thus, any shape, such as for example an "L" between two ^.^ilT £ 1* ^L^ of a 

Sape is treated simpir« another region to be defined .FIG. 7 symbolically Austral*. dKopMor ofa 

Indurated on. B? defining a subversion points 10 bitmap mask to selejvely mask pordons of a source 

for any giver iregion. a» lof '££j****^ TS^s^SSXlustrates the use ofouescan fine 

the region need not be «ored in ««^ Driy ^ ^ ^ ^^ ^ ^^ 

the mversion pomts defining the regwn need be stored. ^ destination 

Briefly stated, in accordance with one typical em- h-m^fordShTv 

bodiment of the present invention, there i* provided ™g f m JJ^ ^ fe$ult rf onc impIimcntatk>(1 of 

means for generating an mput representation ofa re- ^^ ^ |Cgn ^ 

gion, which may comprise any arbitrary shape or area rff^T * 

the perimeter of which need not be a continuous curve ™* y 

and may include disjoint areas. This input representa- NOTATION AND NOMENCLATURE 
tion is ,uost advantageously coupled to a digital com- The detailed dcscription8 wnich foUow m presented 
puter. On* received, the digital computer determines . b l£mi Qf j^,,,,,,, a^ iyin bolic repreaenta- 
the position of the inversion points needed to define the 6qos q{ . opmtion8 on ^ b jtj within a computer man- 
region and sorts the pomts left to right and top to bot- Qry Thec ^gon^c descriptions and representations 
torn in accordance with their coordinates in the region. 2J ^ tfae mcanJ ^ by y^ ^^j ^ ^ dttt proc-ss- 
Algorithm means are provided to transfer Mid operate ^ ^ ^ most effectively convey the substance of 
on regions (or portions thereof) within the computer ^ WQrk J0 othen ^^j m ^ trt 
memory and to display a resulting region on an appro- ^ algorithm is here, and generally, conceived to be 
priate device, such as for example a cathode ray tube a ^.consistent sequence of steps leading to a desired 
(CRT) or the like. 30 result These steps are those requiring physical manipu- 

A scan line mask comprises a one scan line buffer, ^tions of physical quantities. Usually, though not neces- 
which in binary form represents existing regions which sarity, these qu an tities take the form of electrical or 
are currently being displayed and stored in a destination magnetic signals capable of being stored, transferred, 
bitmap. The destination bitmap comprises a block of combined, compared, and otherwise manipulated. It 
memory in which each bit corresponds to a pixel or the 35 p r0V es convenient at times, principally for reasons of 
like on the display device. The scan line mask vertically common usage, to refer to these signals as bits, values, 
scans down and "slices" the existing regions into hori- elements, symbols, characters, terms, numbers, or the 
zontal rows corresponding to each raster line on the i^e. It should be borne in mind, however, that all of 
CRT display. Similarly, data from a source bitmap or th^ and similar terms are to be associated with the 
font file, in the form of characters or the like, to be 40 appropriate physical quantities and are merely conve- 
added to a portion of the destination bitmap is also n^t ] 3 bels applied to these quantities. 
"sliced" and placed into a horizontal scan line buffer Further, the manipulations performed are often re- 
corresponding to each raster scan line of the CRT. As fenzd to in terms, such as adding or comparing, which 
one horizontal scan line is transfered from the source are commonly associated with mental operations per- 
bitmap or the like to the destination bitmap, the contents 45 formed by a human operator. No such capability of a 
of the source scan line buffer are compared to the con- human opefavor is necessary, or desirable in most cases, 
tents of the scan line mask, such that the source scan line m any of the operations described herein which form 
is "masked" and only selected portions of the source part of the present invention; the operations are ma- 
buffer are transferred to the destination bitmap. By chine operations. Useful machines for performing the 
using a variety of region operators, precedence between 30 operations of the present invention include general pur- 
existing and new regions may be specified. Thus, a pose digital computers or other similar devices. In all 
pattern (such as for example striped, checked or the cases there should be borne in mind the distinction 
like) may be added to an existing region, text may be between the method operations in operating a computer 
overlayed, scrollirg of text within a region may be and the method of computation itself. The present in- 
easily accomplished, and numerous other graphics op- 55 vention relates to method steps for operating a com- 
erations may be completed. puter in processing electrical or other (e.g., mechanical, 

The resulting destination bitmap is converted to sig- chemical) physical signals to generate other desired 

nals which are then applied to a CRT or other display physical signals. 

device, and the image is displayed in a conventional The present, invention also relates to apparatus for 

manner. » performing these operations. This apparatus may be 

^ A „„__ specially constructed for the required purposes or it 

BRIEF DESCRIPTION OF THE DRAWINGS ££ Uprise a general purpose computer as selec- 

FIG. 1 illustrates a computer incorporating the pres- tively activated or reconfigured by a computer program 

ent invention. stored in the computer. The algorithms presented 

FIG. 2 shows a typical arrangement of program stor- 65 herein are not inherently related to any particular coin- 
age in the system of FIG. 1. puter or other apparatus. In particular, various general 

FIGS. MaHk) illustrate the use of inversion points to purpose machines may be used with programs written 

define a region. in accordance with the teachings herein, or it may 
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prove more convenient to construct more specialized FIG. 2 show* a typical arrangement of the major 

apparatus to perform tie required method steps. The programs contained within the memory 26 illustrated in 

required structure for a variety of these machines will FIG. 1. In particular, there is shown a video destination 

appear from the description given below. bitmap 38, which in the presently preferred embodi- 

5 ment comprises approximately 32 kilobytes of storage. 

DETAILED DESCRIPTION This destination bitmap represents the video memory 

The following detailed description will be divided for the display monitor 34. Each bit in the destination 

into several sections. The first of these will treat a gen- bitmap corresponds to the upper left coordinate of a 

eral system arrangement for generating computer corresponding pixel on the display monitor. Thus, the 

graphics. Subsequent sections will deal with such as- M> destination bitmap can be described by a twc-dimen- 

pects of the present invention as defining an inputted «°nal *™V of points having known coordinates. Of 

Son in terms of inversion points, the sorting of inver- course, in the case where other d*p lay means are used, 

sion points, operations on inversion points, generation «* '« ** example i .printer or the like, th< <wntentsof 

of a *an linVmask, and region transfer operations '** bitmap 3* would represent the data points to be 

Main juic ju»», 6 t~ 15 displayed by (]„, particular display device. Memory 26 

Taddition, in the following description, numerous *° includes programs 40 which represent a variety of 

specific detail are set forth such as algorithmic conven- sequences of instructor* for execution b> the CFUFor 

*T^ TT . , ui.. mt „ :„ mA „ tn nMX AA» examp e, the control program implimenting the opera- 

tions, specific numbers of b>* , ete, utorder to provide P^ described* this Patent, monitor and 

a thorough undemanding ^v^rnaM ^ ^ ^ ^ 

n^'*^**^*™^;^** may be storcdwTthin this memoTy location, 
the present invention may be practiced without the* ^^ bitmap 42 which may comprise regions, fonte, 

specific detads. In other instances, well-known circuits ^ ^ ? ^di^ ^ cWacters are also 
and structures are not described in defcd in order not to itond ^ m % w my ^ f ^ stored m 

obscure the present mvention unnecessarily. M ^ ^^ ^ 52asnaybc rcquired m My gj ven 

GENERAL SYSTEM CONFIGURATION appUcation of the present invention. Additionally, space 

... within memory 26 is reserved for other programs and 

FIG. 1 shows a typical computer-based system for memory whkh b designatcd 8t 44, 7^ othcr 

generating computer graphic images according to the prognuns ^y j^de a variety of useful computational 

present invention. Shown there is a computer 20 which x Qf rility programs M may be desired, 
comprises three major components. The first of these is 

the input/output (I/O) circuit 22 which is used to com- INVERSION POINT REPRESENTATION OF 

municate information in appropriately structured form DEFINED REGIC NS 

to and from the other parts of computer 20. Also shown j^ e present invention represents any arbitrarily de- 

as part of computer 20 is the central processing unit 3J fined rcgion m lcrm$ f "inversion points". In addition, 

(CPU) 24 and memory 26. These latter two elements are ^ p Tesent invention defines a "region" to be any arbi- 

those typically found in most general purpose comput- tnr y ^ wn i cn ma y include a plurality of disjoint 

ers and almost all special purpose computers. In fact, ^^5 f ^y sn ape or'configuration. Referring now to 

the several elements contained within computer 20 are fiq. 3/^ ^ inversion point 40 is illustrated. An inver- 

intended to be representative of this broad category of 4Q s j on point is, by definition, a point at which the state of 

data processors. Particular examples of suitable data ,u poj nts haviag coordinates to the right and below the 

processors to fill the role of computer 20 included ma- inversion point are inverted. Thus, as depicted, all areas 

chines manufactured by the Apple Computer Co., Cu- to the right ard beiOw the point 40 are dark since point 

pertino, Calif. Other computers having like capabilities 40 was defined on a previously white background. In 

may be of course be adapted in a straightforward man- 45 terms f the phyticd implementation of the inversion 

ner to perform the several functions described below. poj^j system, the position of an inversion point is de- 

Also shown in FIG. 1 is an input device 30, shown in scribed in terms of its coordinates in a memory bitmap, 
typical embodiment as a keyboard. It should be under* as illustrated in FIG. 3(b), a vertical unbounded strip 
stood, however, that the input device may actually be a results when two inversion points, 40 and 42, are de- 
card reader, magnetic or paper tape reader, or other 50 fined on a bitmap such as destination bitmap 38, and 
well-known input device (including, of course, another subsequently displayed on monitor 34. The addition of 
computer). A mass memory device 32 is coupled to the the point 42 on the bitmap inverts the state of all points 
I/O circuit 22 and provides additional storage capabil- having coordinates to its right and below it, cancelling 
ity for the computer 20. The mass memory may include the effect of point 40 within this area and thereby defin- 
other programs, fonts for given characters, and the like 53 ing a darkened vertical strip, 
and may take the form of a magnetic or peper tape Similarly, four inversion points 40, 42, 44 and 46 
reader or other well known device. It will be appreci- define a square or other quadrsxtrle as shown in FIG. 
ated that the data retained within mass memory 32, 3(c). As illustrated in FIGS. 3(d) and (t) other areas may 
may, in appropriate cases, be incorporated in standard be defined using inversion points, and voids within a 
fashion into computer 20 as part of memory 26. 60 given shape may be easily generated. In addition, it will 

In addition, a display monitor 34 is illustrated which be apparent that any given region may contain any 

is used to display the images being generated by the number of disjoint areas, as shown in FIG. 3(/), inas- 

present invention. Such a display monitor may take the much as all shapes within a region are simply defined by 

form of any of several well-known varities of CRT the coordinates of the inversion points, 
displays. A cursor control 36 is used to select command 65 Moreover, circular and other non-linear regions may 

modes and edit graphics data, such as for example a be defined by proper positioning of inversion points, 

particular image, and provides a more convenient With reference to FIG. 3(g), a diagonal line 43 may be 

means to input information into the system. defined between points "X" and "Y" by a step series of 

"LisaPatentQuickDraw 1 1 PICT" 674 KB 1 999-03-07 dpi: 399h x 453v pix: 2550h x 4367v 

Apple Lisa Computer Technical Information | Page 0012 of 0017 



« Apple Computer Patent -- Lisa QuickDraw Graphic Library Regions 

4,622,545 

7 * 

two inversion points between "X" and "Y. M Although a dinate greater then or equal to the vericd coordinate of 

direct diagonal line between points would be preferred, the point in question (point "I" in FIG. 4(a)), and the 

the physical structure of the raster line display monitor inversion point's horizontal coordinate is less than that 

34 does not permit this. Each pixel on the CRT display of point "F\ a variable is "toggled" which is other true 

occupies a unit area between given coordinates, where 5 or false (and which was originally set, for example, to 

by convention a particular pixel is accessed by the coor- false). Thus, each time and inversion point above and to 

dinate of the grid point which lies at its top left Thus, a the left of the point in question is detected, the state of 

step-like function of inversion points defining a series of a true/false variable is switched. If, after scanning 

horizontal line segments is required to approximate a through the list of inversion points defining the region 

diagonal iinc. l0 the variable is true (ie. «* odd number of statechanges 

It will be ^predated that once any given region is occurred) the point in question (Le. point "P") lie* 

defined in terms f>f its inversion points, in general only within the particular region. However, if the variable is 

the inversion points need be retained in memory 26, false (i.e. zero or an even number of statechanges oc- 

unlike many prior art sy:tems which require that virtu- curred) the point is not within the region. Thus, a quick 

ally all points comprising an image be stored. In the 15 and efficient method for determining point membership 

presently preferred embodiment, a region is entered using inversion points is provided by the present inven- 

into the computer 20 by a user by means of cursor con- tion which was not possiole in the prior art 

trol 36 or other input device The positics of the inver- REGION TO SCAN LINE BUFFER 

sion points defining the region is determined by detect* TRANSFORMATION 
ing horizontal line segments which in part form portions 20 

of the imputted region. With reference to FIG. 3(A), line The present invention's u* of ordered lists of inver- 

segments 80, 85, 90, 100 and 125 are thus identified. sion points provides a straightforward means of repre- 

Jnversion points are then defined at the coordinates senting the contents of each raster scan line on monitor 

corresponding to the end points of each line segment 34. Referring now to FIG. 5, portion of memory 40 (See 

thereby defining the entire region in terms of its inver* 25 FIG. 2) is allocated as a one scan line buffer. In the 

sion points. Vertical line segments within the region are presently preferred embodiment this ca.i une*buffer is 

ignored since they will be generated automatically, by sufficiently large such that each horizontal row of pads 

definition, using the previously described inversion on the CRT monitor screen or other output device is 

point convention. The specific sequence of operations represented by a bit within the buffer. A region which 

which are required to be executed by computer 20 to 30 has been previously defined in term* of an ordered list 

detect and isolate horizontal line segments, will be ap- of inversion points may be represented by bit states 

parent to those skilled in the data processing arts, and within the scan line buffer. For every horizontal row 

will not be set forth in this description. The inversion displayed on monitor 34, designated V* Vi, V 2 . . . 

points of a region are sorted into an ordered list of V„+i in FIG. 5, inversion points having vertical coordi- 

points in a left to right top to bottom order in accor- 35 nates corresponding to the particular horizontal row 

dance with their coordinates. For example, with refer- which is scanned are represented by an altered bit state 

ence to the region of FIG. 3(e) the list of inversion (ie. a 1 in an original scan line field of 0*s) at appropriate 

points in accordance with the convention would be as coordinates on the scan line buffer. All bits between 

follows: 54, 56, 58, 60, 62, 64, 66, 68, 70, 72, 74, 76. pairs of inversion points in scan line 155 are then ln- 

It has been found, that the use of the above conven- 40 verted, such that a true representation of the region to 

tion permits simplified operations on regions such as be displayed is gcrerated from the inversion point or- 

those illustrated in FIGS. 4(c)-(<0- Typical operations dered list Thus, as shown in FIG. 5, by scanning 

which may be performed using the present invention's through each horizontal row to be displayed, any re* 

use of ordered lists of inversion points are the functions gion may be horizontally and sequentially "sliced" into 

of the determination of point membership, as well as ths 45 segments one scan line wide 

intersection, union, difference, and exclusive-OR of As will be discussed below, the use of a single raster 

regions. scan line buffer allows a region to be transferred from a 

Frequently, in the course of a graphics operation, it is source bitmap 42 to the destination bitmap 38 and ap- 

necessary to determine if a point in the destination bit- propriately "masked" such that any arbitrary region 

map 38 (and thereby correspondingly displayed on the 50 may be transferred and manipulated, unlike prior art 

display monitor) lies wiinin a particular region. This systems such as BitBlt which are confined to rectangu- 

function is generally referred to as "point metabership , \ lar region transfers. . 

Traditionally, the determination of point membership In addition, it will be appreciated that the region to 

required rather extensive data manipulations and ca'cu- scan line buffer transform is reversable. Once a region is 

latiois. For example, one prior art method of determin- 55 represented in the form of a one scan line buffer, an 

ing ;>oint membership was to calculate and sum the ordered set of inversion points may be redefined by 

angles from the point in question to the region of inter- locating inversion states on the buffer as the buffer scans 

est If the sum of the angles equals 360 degrees then a region from its top (V|) to bottom (V-+iX Inversion 

point membership within the region exists. It will be point positions are located easily inasmuch as an inver- 

appreciated that this particular method of determining 60 sion point position on the buffer is that point where a bit 

point membership requires numerous and repetitive state change is sensed (Le. a 1 where the next bit is a 0). 

calculations and is extremely time consuming. More specifically, in the present embodiment the loca- 

However, the present invention's use of inversion tion of inversion points may simply be determined by an 

points provides an efficient means to determine point exclusive-OR operation between the current scan line 

membership. With reference to FIG. 4(c), the present 65 (e.g., V 3 ) buffer contents and the previous (eg., V-) 

invention scans through the previously ordered list of scan line buffer contents. Thus, the portions of regions 

inversion points defining the region in question, from which remain unchanged between subsequent vertical 

top to bottom. If an inversion point has a vertical coor- scan line positions are ignored inasmuch as a uniformity 
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of content between one vertical scan line position and lotting the inversion point lists of regions "T* and "IT 
the next would indicate that no inversion points are of FIG. 4(e), and discarding any points having the same 
present In addition, horizontal positions of inversion coordinates in both regions. In other words, computer 
points may then be determined by shifting the resulting 20 simply treats the ordered lists of inversion points 
exclusive-OR ed scan line to the right by 1 bit, and 5 defining regions T* and "U" as one large list, and sorts 
effectuating aaother exclusive-OR operation. For ex- all of the inversion points, left to right and top to bottom 
ample, if after the exclusive-OR operation between scan j„ accordance with the previously described conven- 
line buffer V„ and V«_ i the result was 01 1 1001 1, then tion jh e resultant list of inversion points represents a 
by shifting the result to the right one bit and completing region whose p^,^ Kt contained either in region *T H 
another exclusive-OR operation we obtain: 10 or «ij» but Ilot ^fa 

It will be appreciated that numerous other operations, 

Oil loon and combinations of operations, using the present inven- 

Oiooioio - mvenionpriu piJom for ku line v. ' . tion's inversion point and scan line buffer method may 

be performed on arbitrary regions that was possible in 

The specific commands to be executed by computer prior art methods. 
20 in order to determine where in a scan line buffer a SCAN LINE MASK 

state change exists will be apparent to one skilled in the 

art, and will not be further described. With reference now to FIG. 7, the present invention's 

, n use of a scan line mask to provide arbitrary region clip- 
REGION OPERATORS « ping K 8ym bolicaIly illustrated. A previously defined 

The present invention's use of a one scan line buffer region 160 which has been converted into an ordered 
to systematically represent the contents of regions per- list of inversion points is used as a "mask" to which all 
mits the previously described operations of union, inter- additional images to be displayed on the monitor 34 are 
section, etc., to be easily accomplished. For example, ^ compared, prior to affecting the destination bitmap 38. 
the intersection operation illustrated in FIG- 4(6) pro- y^ s jj wn in FIG. 9, it is frequently desired that multi- 
vides an inversior point representation of the shaded pj e re gj ns overlap with some predetermined prece- 
area, and is obtained by executing an "AND" of the two dence ^ ^ j^rated, folders may be depicted as over- 
overlapping regions "A" and *'B." Referring now to lapping, text may be provided on each displayed folder, 
FIG. 6, a one scan line buffer is defined for each region ^ Md othcr arbitrary regions may be displayed. However, 
"A M and "B." For each horizontal raster row of the u $ xliSSed abovCi prior m mct hods such as BitBlt are 
CRT display, the respective scan line buffer represents strained to rectangular "region clipping". This, the 
each region's contents in binary form. The contents of vcrsatiIity of prior ^ systeins K severely footed by the 
the scan line buffers are then operated upon m order to amtaiat of ^ on rec tangular regions only, and 

accompush the . d ^£^* ^^J* "£ 35 their inability to selectively affect regions other than the 
40),thecontems wouldbe AND ed togethe toresUt folder 

m a compose scan line. For example, if for vertical ^ syniboiically ^^ m nc ?( othcr regions 

position Vj. such ^ pattens or characters are comp ued to a bitmap 

"A"ic«niine-iiiiiioo "mask", one scan line at a time, of existing regions 

40 which are currently being displayed. As will be dis- 

"B"*cmi line- looioooi cussed below, by defining region operators various 

masking priorities may be defined. Thus, patterns may 
Then the composite scan line after an "AND" opera- he provided as well as fonts and other characters within 
tion would be: IGOluOOO. In addition, the identical ^y arbitrary region. "Region clipping" is provided in 
"AND" operation is done for each horizontal row V, 45 accordance with the region operators such that portions 
comprising each region. The result of the above opera- f overlapping regions are selectively displayed, 
tion being a composite representation, one scan line at a Referring now to FIG. 8, each source bitmap 42 
time, of the resulting intersecting shaded region "C" of wnicn ^ comprise an image, character, font or the 
FIG. 4(6). The position of the inversion points compris- ^ which ^ desired t0 ^ displayed is "sliced" and 
ing the shaded region "C" may then be extracted using 50 transformed mt0 a one scan line buffer in accordance, 
known techniques, such as the exclusive-OR operation ^ ^ cxamplC) At above discussion under the head- 
previously described. fa "Region to Scan line Buffer Transformation." Thus, 
Similarly, an "OR" operation between the two re- ■ • tQ ^ , ^ h nsented by a one ^ 

E?! 1 ?' t^w 0^d ^^ C S eV ^^S/T^th I « sci buffer which horizontally scans the source bitmap 
FIG. 4(c). To obtam the Difference of I IG^the 55 representation of the source 

E'iW' £ f ^° nS r ™? * ,22T region by proper expansion of inversion point positions 
"S ) AND "R", wherein the state of a,I binary quanti- '** ,v " 7; ?„ 

ties represented within the "S" scan hne buffer is in- "^g me D . uner ' . *«i.u«i 

vertedprtor to "AND"ing the contents with the "R" , ™* !^ ora . t wia ?}, m . P™ 501 ^ *«« ****? 
scanline buffer » form a bstma P mask K & on w wbjch new "B 10115 to 

Finally, the exclusive-OR operation of FIG. 4(e) is be displayed are compared- A* « done with the new 
simply achieved by performing the exclusive4DR on ™>*<x regions to be added, the existing displayed re- 
each region's scan line buffer contents, in the same man- goin is transformed into a one scan hne mask represent- 
ner as was done in the above example of the "AND" ing the contents in binary form of the destination re- 
operation. However, it will be apparent to one skilled in 65 gion. Depending on the transfer mode operation speci- 
the art that the present invention's use of ordered lists of fied, each scan line of the new region is selectively 
inversion points renders the exclusive-OR operation transferred to the destination bitmap 38 and displayed 
trivial. The operation may be accomplished by merge on the display monitor 24. 
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The specific type of transfer mode operator used is a CODING DETAILS 
function of the desired output. Region operators include ' 

the functions of OR, AND, exclusive-OR, NOT as well No particular programming language has been indi- 
as any combination thereof. For example, if the current cated for carrying out the various procedures described 
scan line mask for row Vj on the CRT contains 5 above. This is in part due to the fact that not all lan- 
01 101010 and the current source scan line buffer for Vu gucges that might be mentioned are universally avail- 
contains 01 1001 10 then the result after an "AND" oper- able. Each user of a particular computer will be aware 
ation which would be displayed on monitor 34 would of the language which is most suitable for his immediate 
be: purposes. In practice, it has proven useful to substan- 

10 tially implement the present invention in en Assembly 

MmoM.MteaMkMhrcosftMi hmguage wmch provides a machine executable object 

(AND) 01 lOOOlO • KHirce nan me buffer content! code. 

oiioooio - d«tm»tK>n tamp %au> line content* Because the computers and the monitor systems 

to be ditpUycd which may be used in practicing the instant invention 

" consist of many diverse elements, no detailed program 

Thus, it will be appreciated that not all portions of the Stings have been provided. It is considered that the 

new source region will be transferred to the display operations and other procedures described above and 

device, and is thereby "clipped" depending on the par- illustrated in the accompanying drawings are suffi- 

ticular transfer operator chosen. In addition, it will be giemly disclosed to permit one of ordinary skill to prac- 

noted that the particular shape of the regions being 20 tiw ^ iastmt invention or „ mucn f it as is of use to 

operated upon is irrelevant to the method of the present him. 

invention. The use of inversion points and one scan line j^ mct hods and apparatus which are most advan- 

buffers allow any arbitrary region to be defined, masked tageously used in conjunction with a digital computer 

and transferred by the present invention. t0 pr0 vide improved graphics capability have been 

In the presently preferred embodiment, three sepa- 25 discloscd j bt presem invention's use of inversion 

rate scan line mask buffers are provided to which a new ^^ aod g^ i^ masking allows any arbitrary region 

source region is compared. A "user region" mask com- t0 ^ defined, manipulated and transferred fasicr and 

prises the existing region being displayed which the more efficiently than systems previously found in the 

new region, if transferred, will affect. A "visible re- ^ 

gion" mask is defined as the visible portion of the exist- 3° ^^^ tne prescnt invention has been particularly 
ing region currently being displayed (e.g., folder 200 of described with reference to FIGS. 1-9 and with empha- 
FIG. 9). The "clipping region" comprises the visible sis on ceTtzin computer systems, it should be understood 
portion of the user region to which the new source that tne figures are for illustration only and should not 
region will be "clipped", such that only a portion of the ^ ^^ ^ limitations upon the invention. In addition, it 
source region is transferred. Thus, a new source region -^ ^^ tnat the methods and apparatus of the present 
to be transferred from the source bitmap 42 to the desti- inventions has utility in any application where graphic 
nation bitmap 38 is passed through the equivelent of representations on a CRT or other display device are 
three scan line mask buffers. In practice, each scan line desired. It is contemplated that many changes and mod- 
mask is "AND" ed with one another and the composite ifications may be made, by one of ordinary skill in the 
scan line mask is then utilized to mask new regions. ^ without departing from the spirit and scope of the 

With reference to FIG. 9, an example of an output invention as disclosed above, 

displayed on monitor 34 in accordance with the present { r w, m - 

invention is illustrated. Region 200 was originally de- i t a. computer display system, comprising: 

fined by a user and stored ir memory 26 as an ordered +J display means for providing a display including a 

list of" inversion points. By specifying a proper region , plurality of display elements, each of said display 

operator as described above, regions 210 and 240 have elements being selectively enabled; 

been displayed such that it appears that region 200 lies memory means for storing a plurality of inversion 

between regions 210 and 240. Similarly, text has been points, each of said inversion points having a coor- 

provided within each folder shaped region, and appro- jq dinate corresponding to an element on said display, 

priate region clipping using the scan line mask method wherein the coordinates of each inversion point 

as described above insures that only those portions of specify orthogonal lines extending in the direction 

each region which would be visible if actual folders of subsequently enabled display elements from said 

were used is displayed. inversion point and forming two boundaries of a 

Moreover, it will be apparent to one skilled in the art 55 contrasting area; 
that although the present invention has been described processing means coupled to said memory means for 
with emphasis on binary representations on the display enabling elements on said display which corre- 
device 34, and therefore in black and white, that appro- spond to said stored inversion points, and generat- 
priate inversion point and scan line masking for color ing said contrasting areas on said display, the con- 
images may also be achieved. For example, to provide 60 trast of an area being a function of the coordinates 
the colors of red, green and blue, three inversion point of previously displayed inversion points; 
representations of a region may be utilized, one for each whereby a region which comprises a plurality of 
color respectively. Thus, the presence of an inversion inversion points may be displayed by enabling said 
point in one color region may selectively discharge a corresponding elements and generating said associ- 
color gun in a color CRT or the like for that color. 65 ated contrasting areas on said display means. 
Similarly, various colors could be acheived by the ap- 2. The display system of claim 1 wherein said display 
propriate combination of the three inversion point rep- means includes a plurality of raster scan lines compris- 
resentations of each region stored in memory. ing said elements defining said display. 

"LisaPatentQuickDraw 1 4.PICT" 628 KB 1 999-03-07 dpi: 399h x 453v pix: 2559h x 4368v 

Apple Lisa Computer Technical Information | Page 001 5 of 001 7 



« Apple Computer Patent -- Lisa QuickDraw Graphic Library Regions 

4,622,545 

13 14 

3. The display system of claim 2 wherein said process* least two inversion points having the same coordinates 
ing means includes reading means for reading said in- in different bitmaps, each of said inversion points corre- 
vcrsion points from said memory in the order in which sponding to a different color to be displayed on said 
said elements are scanned by said display means. display means. 

4. The display system cf claim 3, wherein said pro- S 17. A method for generating and manipulating 
ceasing means includes sorting means for sorting said graphic representations on a computer controlled dis- 
inversion points into an ordered list in accordance with play system, said display system including a plurality of 
a predetermined convention and storing said list in said display elements, each of said elements being selectively 
memory means. enabled, comprising the steps of; 

5. The display system of claim 4 further including 10 providing memory means within said computer in- 
input means coupled to said processing means for input- eluding storage for a plurality of inversion points, 
ting a region to be displayed into said memory. -^h f said inversion points having a coordinate 

6. The display system of claim 5 wherein said process- corresponding to an element on said display sys- 
ing means further includes inversion point locating tern, wherein the coordinates of each inversion 
means for determining the coordinates of inversion 15 p^ specifv orthogonal lines extending in the 
points comprising said inputted region. direction of subsequently enabled display elements 

7. The display system of claim 6 wherein said process- {tom ^ mvmion ^ ^ fofming ^o bound- 
ing means further includes logic means for executing ^ of a contrasting area; 

logic operations between ordered lists of inversion inputting a region comprising a plurality of inversion 

points defining at least two regions. 20 ^ mt0 ^ memory meaM . 

8. The display system of claim 7 wherein *aid logic 4^^ j^ Version points comprising said re- 
opcratjons include the functions of logical AND, OR, ^ by eBiUing ^ sounding elements on 

N OT^ d "elusive "° R ; ,,„...,.,. said display and generating said contrasting areas 

9. The d*play system ofciaim 7 wherein said reading on ^/^ , ^ ^^ of , ^ ^ , 

means reads a destination bitmap within said memory 25 function of ^ coordinates of previously displayed 

means, said destination bitmap including a plurality of . r 

mversion points representing regions currently being £ ; 

displayed on said raster scan display. . . ■?•*•* 

10. The display system of claim 9 wherein said mem- inversion pomts c^mpmmg said region and gener- 
ory means further includes at least one source bitmap, 30 ^ n « m6 moeMed contrasting areas on said dis- 
said source bitmap including a plurality of inversion -«%!?' ... ... j. ,- «- f -v • j 

points representing regions at least some portion of . !«• The methcj as defmed by claim 17 further mclud- 

which may be transferred to said destination bitmap. m * ** * tc ? of "lenufying and storing in said memory 

11. The display system of claim 10 wherein at least **£*** ,nv "T *°T d J efimn « ."*"*»■• . 

one scan line buffer is defined within said memory 35 »■ ™ e method as defined by claim 18 wherein said 

means, said scan line buffer being sufficiently large such djs P lav . system includes a plurality of raster scan hnes 

that it contains adequate bits to revreseet all elements comprising said elements of said display, 

disposed along a scan line of said raster scan display. *>■ ^ "K^ M defined by a»ini 19 further includ- 

12. The display system of claim 11 wherein said read- "8 ** ste P of readm 8 ™ 6 inversion potnts defining 
ing means sequentially reads inversion points in said 40 said region from said memory m the order m which said 
source bitmap and provides a representation of said elements are scanned by said display system. 

region in said scan line buffer thereby providing a scan 21. The m ethod as defined by claim 20 wherein said 

of said region in said source bitmap corresponding to *0"ng step includes sorting said inversion points into 
each scan line of said display means. *» ordered list in accordance with a predetermined 

13. The display system of claim 12 wherein at least 45 convention. 

one scan line mask buffer is provided within said mem- 22. The method as defined by claim 21 wherein said 

ory means, said scan line mask sequentially providing a sorting convention comprises sorting said inversion 

scan of said destination bitmap such that the contents of Points in accordance with their coordinates, such that 

said scan line mask are representative of a region stored said points are sorted left to right and top to bottom 

within said destination bitmap in the order in which it is 50 relative to one another, 

scanned by said display means. 23. The method as defined by claim 22 further includ- 

14. The display system of claim 13 further including hig the step of providing a one scan line bufler defined 
comparison means for comparing the contents of said within said memory means, said reading means sequen- 
scan line mask and said scan line buffer, such that prior tially providing a representa ion of said region in said 
to the transfer of the contents of said scan line buffer 55 scan line buffer corresponding to each scan line on said 
from said source bitmap to said destination bitmap for display. 

display, the contents of said scan line buffer are com- 24. The method as defined by claim 23 further includ- 

pared to the contents of said mask buffer for each scan ing the step of providing a one scan line mask buffer 
line position of said display means. within said memory means, said mask buffer sequen- 

15. The display system of claim 14 further including 60 tially providing a representation of a region being di»- 
precedence control means for providing a predeter- played on said display such that the contents of said 
mined priority as defined by a user between the contents mask buffer correspond to each scan line of said display. 
of said scan line mask buffer and said scan line buffer as 25. The method as defined by claim 24 further includ- 
compared by said comparison means, and for transfer- _ ing the step of comparing the contents of said scan line 
ring portions of said scan line buffer which have prece- 65 buffer with the contents of said scan line mask, 
dence to said destination bitmap for display. 26. The method as defined by claim 25 further includ- 

16 The display system of claim 15 wherein each ing applying a predetermined priority between the con- 
region inputted into said memory means is defined by at tents of said scan line buffer and said scan line mask, 
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such that cnly selected portions of said scan line buffer 
contents are displayed on said display system. 

27. A method for selectively transferring data from a 
first location in a computer memory to a second loca* 
tion in said memory, comprising the steps of: 

defining a one scan line buffer in said memory, said 
scan line buffer sequentially representing said data 
in said first location; 

defining a one scan line mask buffer in said memory, 
said scan line mask sequentially representing data 
in said second location; 

sequentially comparing the contents of said scan line 
buffer with the contents of said scan line mask prior 
to the transfer of the contents of said scan line 
buffer to said second location; 

providing a predetermined precedence as defined by 
a user between the contents of said scan line buffer 
and said scan line mask, such that only selected 
data comprising said scan line buffer having prior- 
ity is transferred to said second location; 

whereby data is selectively transferred from said first 
location to said second location. 

28. The method as defmed by claim 27 wherein said 
second location comprises a plurality of bits, each bit 25 
corresponding to an element on a display system. 

29. The method as defined by claim 28 wherein data 
in said second location is displayed on said display sys- 
tem. 

30. The method as defined by claim 29 wherein said 30 
scan line buffer sequentially represents said data in said 
first location in the order in which said data will be 
displayed on said display system. 

31. The method as defined by claim 30 wherein said 
scan line mask sequentially represents data in said sec 
ond location in the order in which said data is displayed 
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20 



35 



32. The method as defined by claim 31 wherein said 
data within each of s&id locations is representative of at 
least one region, said region comprising a plurality of 
inversion points each of said points having a coordinate 
corresponding to an element on said display, wherein 
coordinates of each inversion point specify orthagonal 
lines extending in the direction of subsequently enabled 
display elements from said inversion point and forming 
two boundaries of a contrasting area. 

33. The method as defined by claim 32 wherein the 
process of determining the location of inversion points 
defining said region includes the steps of: 

detecting horizontal line segments comprising said 
region; 

defining inversion points at coordinates correspond- 
ing to the end points of said line segments. 

34. The method as defined by claim 33 further includ- 
ing the step of sorting said inversion points defining said 
region in accordance with a predetermined convention. 

35. The method as defined by claim 34 further includ- 
ing a process to determine if a specified point lies within 
said region, said region being defined by an ordered list 
inversion points arranged such that said inversion points 
are sorted in accordance with their coordinates left to 
right and top to bottom relative to one another, com- 
prising the steps of: 

defining at least one flag bit in said memory, said flag 
bit initially set in a first state; 

scanning through said ordered list and switching said 
flag bit to a second slate in a event that an inversion 
point in said list has a vertical coordinate greater 
than or equal to the vertical coordinate of said 
specified point and a horizontal coordiate less than 
that of said specified point; 

determining the state of said flag bit 
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